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(S) Image processing apparatus. 

(g) In the apparatus for processing a color image, a data signal representing another infonmatlon differs 
from the color image is generated by a generating means (103). The another infonnation is embedded 
into the color image by varying one of a color difference and a chroma of the color image in accordance 
with the data signal by an image processing means (104, 105). 
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This invention relates to an image processing apparatus for embedding another information into image 
information without causing the unnatural sense of vision by use of a redundancy included in the image infor- 
mation, and/or an image processing apparatus for extracting another information from the image information 
into which the another information is embedded. 

5 The technique for superposing text data on an color image and recording the same is disclosed in the article 

by Nakamura, Matsui et al. "Combining/Coding Method of Text Data to Image by Color Density Pattern" Image 
Electronics institution Papers, Vol. 17, No. 4 (1988), pp. 194-198. According to this technique, an attention is 
directed to the point that image data has a higher redundancy. Another data, for example, text data is super- 
posed on the redundancy portion of the image data by use of color density pattern method. However, in gen- 

10 eral, the resolution is lowered when the color density pattern method is used and It becomes impossible to 
display a high-definition image. Further, the image quality is degraded by irregular color or the like due to a 
variation in the pixel anrangement caused by super-position of information. 

As an example of application of dither Image recording capable of permitting higher definition display conv 
pared with that of the color density pattern method, the technique is disclosed in the article by Tanaka, Naka- 

IS mura, Matsui "Embedding of Character Information into Compositional Dither Image by 2k-Dimensional Vector" 
Image Electronics Institution Papers, Vol. 19, No. 5 (1990). pp 337-343. The technique has a defect that the 
image quality is degraded when character information is embedded. Further, the technique has another defect 
that it cannot be applied to the high-definition recording technique such as the error diffusion recording method. 
In addition, according to the above techniques, even if it is possible in principle to extract character infer- 

20 mation or the like from an actually printed image, dither pattern information cannot be precisely printed on 
paper or the like in the actual general recording process and it is difficult to read such information. Therefore, 
it becomes extremely difficult to read the embedded infonmation. It is only possible to extract from the image 
data (such as transmission data and data in the floppy disk) used as a basis for printing. In order to read out 
coded specified information such as character information from the actual recording image based on the above 

25 techniques, it is definitely necessary to use an extremely high precision printer which can print the image with 
high resolution exceeding the limit of eyesight of a man and reads the image by use of a high precision reading 
device. 

Further, with the above method, noises at the time of recording and reading will occur and it becomes dif- 
ficult to read the coded informatton such as character informatton separately from the image informatk)n. In 

30 addition, even if the color-recorded image information is recorded by use of a high precision recording device, 
image dots of respective colors of the color-recorded image information overlap each other, and therefore, it 
is difficult to form a precise pixel shape. In this case, it is extremely difficult to read pixel data of the respective 
colors separately from the image information. 

Further, in Japanese Patent Disclosure (KOKAI) No. 4-294682, the technique for attaching another infor- 

35 mation to the yellow ink is described. According to this technique, there occurs no problem when an original 
image is constructed only by pixels containing only the yellow component. However, when it contains another 
color, it is impossible to ensure that an image which is not visually significant can be recorded simply by adding 
yellow. Further, in the case of cyan or magenta which does not contain the yellow component, a problem that 
the specified information cannot be added occurs. 

40 An object of the present Invention is to provide an image processing apparatus for embedding another in- 
formation into image infonnation without giving the unnatural sense of vision. 

Another object of the present invention is to provide an image processing apparatus capable of easily ex- 
tracting another information from an image in which the another information is embedded. 

According to a first aspect of the present invention, there Is provided an apparatus for processing a color 

45 image, characterized by comprising: means for generating a data signal representing another infomfiation 
which differs from the color image; and image processing means for embedding the another infonfnatton into 
the color image by varying one of a color difference and a chroma of the color image in accordance with the 
data signal. 

According to a second aspect of the present invention, there is provided an apparatus for processing a 
50 color image, characterized by comprising: means for generating a data signal representing another infomnation 
which differs from the color image; and image processing means for embedding the another information into 
the color image by superposing a moire pattern on the color image, the moire pattern including a plurality of 
frequency components in accordance with the data signal generated by the generating means. 

According to a third aspect of the present invention, there is provided an apparatus for processing a mone- 
ys chromatic image, characterized by comprising: means for generating a data signal representing another infor- 
mation which differs from the monochromatic image; and image processing means for embedding the another 
information into the monochromatic image by varying luminance of the monochromatic image in accordance 
with the data signal. 
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As described above, according to the present invention, the another information can be embedded into 
color image information without giving the unnatural sense of vision and causing degradation in the image qual- 
ity when the image information is printed. 

This invention can be more fully understood from the following detailed description when taken in con- 
5 junction with the accompanying drawings, in which: 

FIG. 1 is a block diagram showing an embedding processing section in an image processing apparatus 

according to first and fourth embodiments of the present invention; 

FIGS. 2A and 2B are diagrams showing a pattern generated by a pattern generating circuit shown in FIG. 
1; 

10 FIG. 3 is a graph showing the degree of gradation identifying ability of a human being for variations in the 
directions of luminance, color difference and chronna; 

FIG. 4 is a diagram showing an original sheet on which image information having specified information 
embedded therein is printed and a sheet used for reading; 

FIG. 5 is a flowchart showing the process of the readout processing section in the image processing ap- 
15 paratus according to the first embodiment of the present inventton; 

FIG. 6 is a block diagram showing an embedding processing section in an image processing apparatus 
according to second and fifth embodiments of the present invention; 

FIG. 7 is a graph showing the distribution of the sensitivity of a human being for a pattern of the same 

period; 

20 FIG. 8 is a block diagram showing an embedding processing section in an image processing apparatus 
according to a third embodiment of the present invention; 

FIG. 9 is a block diagram showing an embedding processing section in Image processing apparatus ac- 
cording to sixth and seventh embodiments of the present invention; 

FIGS. 1 0A to 1 0C are diagrams showing the bit arrangement on a Fourier transform plane used in the sixth 
25 embodiment shown in FIG. 9; 

FIGS. 11Aand 11B are diagrams showing the bit arrangement for prevention of enroneous detenrri nation 
on a Fourier transform plane used in the sixth embodiment shown in FIG. 9; 

FIG. 12 is a flowchart showing the process of the readout processing section in the image processing ap- 
paratus according to the sixth and seventh embodiments of the present invention; 
30 FIG. 13 is a diagram showing the bit arrangement on a Fourier transform plane used in the seventh em- 
bodiment shown in FIG. 9; 

FIG. 14 is a block diagram showing an embedding processing section in image processing apparatus ac- 
cording to eighth and tenth embodiments of the present invention; 

FIG. 1 5 is a diagram showing the bit arrangement on a Fourier transform plane used in the eighth embodi- 
35 ment shown in FIG. 14; 

FIG. 16 is a block diagram showing an embedding processing sectk>n in an image processing apparatus 
according to a ninth embodiment of the present invention; 

FIGS. 17Aand 17B are diagrams showing format of transferring data in the ninth embodiment shown in 
FIG. 16; 

40 FIG. 1 8 is a diagram showing the bit arrangement on a Fourier transform plane used in the tenth embodi- 
ment shown in FIG. 14; 

FIG. 19 is a diagram showing the output character arrangement on a n^nuscript paper in the tenth em- 
bodiment shown in FIG. 14; 

FIGS. 20A to 20D are diagrams showing cases wherein this invention is applied to an ID card having a 
45 photograph recorded therein in the first to seventh embodiments; 

FIG. 21 is a diagram showing the color coordinate system defining directbns of the color differences; 
FIG. 22 is a diagram showing an embedding processing sectton in the case where the pattern signal is 
directly added to the color signals with regard to the first to fifth embodiments; and 
FIG. 23 is a diagram showing an embedding processing section In the case where the pattern signal is 
50 directly added to the color signals with regard to the sixth and seventh embodiments. 

FIG. 1 is a block diagram showing an embedding processing section in an image processing apparatus 
according to a first embodiment of this invention. Three color component signals of substructive mixture Y, M, 
C which representing color densities of yellow, cyan, magenta in color image record ing/printing are supplied 
to an input system 1 01 fomied of an input terminal or the like. First color signals Y, M, C input to the input system 
55 101 are supplied to a first conversion circuit 102. The first conversion circuit 102 effects the first converting 
operation based on the color signals Y, M, C supplied from the input system 101 so as to create a luminance 
signal I and two color difference signals C1, C2. The luminance signal I is supplied to a second conversion 
circuit 106. The color difference signal CI which is one of the above two color difference signals CI, C2 Is 
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directly supplied to the second conversion circuit 106 and the color difference signal C2 is supplied to the sec- 
ond conversion circuit via an adder 105. 

The present emt>odlment includes a code generator 103. The code generator 103 holds another informa- 
tion which is different from image information (hereinafter referred to as specified infonmation) and to be em- 

5 bedded into the color image, generates the specified information as code, and supplies the same to a pattern 
generating circuit 104. On the basis of this code, the pattern generating circuit 104 supplies to the adder 105 
a pattern signal which is formed of rectangular waveform, as shown in FIG. 2A, in accordance with bit data 
"0", "1 " constructing the code. If this pattern signal is repeatedly generated throughout plural lines, then a strip- 
ed pattern is generated as shown in FIG. 2B. The same pattern signals may be repeatedly generated in the 

10 main scanning direction in the case where a width of the pattern signal is shorter than a length of one scanning 
line. 

The adder 105 adds (or subtracts) the pattern signal from the pattern generating circuit 104 to (or from) 
a color difference signal C2 from the first conversion circuit 102, A signal CC2 obtained as the result of addition 
is supplied to the second conversion circuit 106. The second conversion circuit 106 effects the second con- 
15 verting operation based on the luminance signal I and color difference signal CI from the first conversion circuit 
102 and the signal CC2 from the adder 1 05 so as to create second color signals r. M*. C which representing 
color densities of yellow, cyan, magenta in recording/printing of colorimage into which the specified infonmation 
is embedded. 

The second color signals Y', M', C* are supplied to an error diffusion processing circuit 107. The error dif- 
20 fusion processing circuit 107 subjects the received color signals r, M', C to the error diffusion process to ae- 
ate an error diffusion pattern. The generated error diffusion pattern is supplied to an output system 1 08. The 
output system 108 is, for example, a color printer, a color copying machine, or a color facsimile equipment, 
and outputs a color image (where, the specified pattern is being embedded into the color image by the adder 
105) in accordance with the received error diffusion pattern. The error diffusion processing circuit 107 is not 
25 always required to provide. In this case, the second color signals Y, M', C output from the second conversion 
circuit 1 06 are directly supplied to the output system 1 08. The output system 1 08 outputs a color image on the 
basis of the second color signals Y\ M', C. 

Next, the operation of the first embodiment is explained. 

The first color signals Y, M, C corresponding to ink amount in the printing of a color inrtage are supplied to 
30 the first conversion circuit 1 02 from the input system 1 01 . In the case where a color of the color image is white, 
a value of the first color signal is set as Y=M=C=0, whereas in the case where a color of the color image is 
black, a value of the first color signal Is set as Y=M=C= 1 . The first color signals supplied from the input system 
are converted Into a luminance signal I and color difference signals CI , C2 by the first conversion circuit 102. 
The conversion from the first color signals Y, M, C to the luminance signal I and color difference signals CI , 
35 C2 is effected according to the following equations. 

I = 1 - (Y + M + C)/3 (1) 
CI = M - C (2) 
C2 = Y - M (3) 

where, I indicates an amount corresponding to the luminance, CI indicates a color difference in a direction 
40 from cyan to magenta, and C2 indicates a color difference in a direction from magenta to yellow. 

Assume that a C1-C2 color coordinate system is provWed, as shown in FIG. 21. In this color coordinate 
system, six primary colors Y, M. C, R. G, B are arranged on the predetermined points. These points define 
the directbns of color differences. As is apparent from the color coordinate system, the direction R-C can be 
expressed by the direction M-C (CI). Similarly, the direction Y-B can be expressed by the direction Y-M (C2). 
45 The thus created luminance signal I and color difference signal CI are supplied to the second conversion 
circuit 106 and the color difference signal C2 is supplied to the adder 105. 

Assume that specified information to be embedded into Image Information contains printing date and time, 
name of the manufacturer, a type, and serial number of the printer, for example. Thus, by means of embedding 
specified information which indicates by which machine the printed matter is printed, the forgery may be dis- 
50 covered in a case that the printed matter is forged. As a result, an effect of the prevention from forgery is en- 
hanced. The code generator 1 03 has a dock generator for creating printing date and time and includes a mem- 
ory which has the name of the manufacturer, the type and the serial number of the printer previously stored 
therein. The specified informatton is generated from the code generator 103 in a code form. 

Further, assume that the code includes data constructed by a total of 72 bits (corresponding to 9 bytes) 
55 including 17 bits for the date (displayed by six digits in the decimal notation), 11 bits for the time, 10 bits for 
the name of the manufacturer, and 34 bits for the name of the type and the device number assigned in this 
order from the most-significant-bit position, for example. 

On the basis of the above code, the pattern generatton circuit 104 supplies a pattern signal fonmed of reo- 
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tangular wave which has simple ON and OFF levels as shown in FIG. 2A. 

The adder 105 adds this pattern signal to the color difference signal C2 in the direction from blue to yellow. 
The pattern signal is generated throughout plural scanning lines. Thus, the striped pattern, shown in FIG. 2B, 
is superposed on the color image with reference to Y-M color difference. The pattern signal is added so that 
5 medium level of its amplitude can Indicate 0 level of the image signal. If the amplitude Is expressed by ± a/2 
as shown In FIG. 2A, the color difference signal CC2 to which the pattern signal Is added can be expressed 
by the following equation. 

CC2 = C2±a/2 (4) 

The symbol represents a case where a bit of the code indicates "1", The symbol "-" represents a case 
10 where a bit of the code Indicates "0". Meanwhile, the pattern (shown in FIG. 2B) appearing later must not give 
the unnatural sense of vision. Therefore, It Is necessary to set the amplitude a and period t (shown in FIG. 
2A) of the pattern by taking the limit of visual sense of a man into consideration. In this case, the pattern be- 
comes less significant to the eyes of the man as the amplitude thereof is smaller and the period thereof Is short- 
er. 

15 FIG. 3 is a graph showing the results of study on the gradation identifying ability of a man in a case where 
variations in gradation are made in the luminance direction, color difference (Y - M) direction and chroma di- 
rection white an observer is observing a sample output by use of a printer capable of printing an Image of as 
high frequency as 300 dpi. In this graph, the frequency is taken on the abscissa and the gradation identifying 
ability is taken on the ordinate. As is clearly seen from the graph, the gradation Identifying ability of the human 

20 being is relatively lower for a variation in the color difference (Y • M) direction than for a variation In the lumi- 
nance direction. Further, it is relatively lower for a variation in the chroma direction than for a variation in the 
color difference (Y - M) direction. 

Further, as Is dearly understood from FIG. 3, the visual sensitivity is abruptly lowered for a frequency high- 
er than approx. 2 cycle/mm. That is, if a high frequency exceeding 2 cycle/mm is applied to the above pattern, 

25 the visually identifiable gradation number becomes less than approx. 60 gradations in the luminance direction 
and approx. 20 gradations in the color difference direction and chroma direction. Therefore, it cannot be iden- 
tified by the human eyes even if the amplitude a is set relatively large. Further, since the amplitude of the pat- 
tern itself is large, the possibility that it is erased by noises is low. Therefore, even if a sensor with high S/N 
ratio Is not used, the pattern can be easily extracted. Further, if the frequency of a pattern to be embedded 

30 Is set equal to or higher than 3 cyde/mm, the possibility that it is visually identified can be lowered. In this 
case, it is sufficient to use a printer which can reproduce the frequency of 3 cyde/mm or more, that is, a printer 
which can reproduce image dots with the resolution of 6 dot/mm (= 150 dpi) or more. It is not necessary to 
use a printer of specifically high precision. That is. it is sufficient If normal color image reproduction is possible 
and higher precision recording Is not particularly necessary. 

35 The signal CC2 created by the adder 105 is supplied to the second conversion circuit 106. Further, the 
luminance signal I, color difference signal CI and signal CC2 are converted Into the second color signals Y', 
M\ C by the second conversion circuit 106. In this case, the conversion Into the second color signals is effected 
according to the following equations. 

Y' = 1 - 1 + (CI + 2CC2)/3 (5) 

40 M* = 1 - I + (CI - CC2)/3 (6) 

C = 1 - I - (2.C1 + CC2)/3 (7) 
Thus, the second color signals Y*. M', C representing a color image into which specified information is 
embedded can be obtained. 

Substituting I, CI . C2. and CC2 of the equations (1 ) to (4) Into the equations (5) to (7). the following relation 

45 is obtained. 

Y + M + C = r + M' + C (8) 
Therefore, it is understood that the total color signal after the specified information is embedded is equal 
to the total color signal before the spedf led infbnnation is embedded. That is, the equatbn (8) indicates that 
the total ink amount is not changed due to the embedding process. 
50 Next, when a printer whose gradation number is limited is used as the output system 1 08, pseudo gradation 
expression is made by use of a multiple error diffusion method. In this case, after embedding the pattern cor- 
responding to the specified information into the image infonmation and deriving color signals by the second 
conversion circuit 106, an enror diffusion pattern is generated from the error diffusion processing circuit 107. 
By adopting expression in gradation by use of error diffusion method, the embedded spedf led information 
55 becomes more difficult to visually Identify. 

In the output system 108, the spedf led Information Is embedded into the image Information and thus output 
(printed). 

Next the readout process of the specified Information output in the above procedure is explained. 
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In the readout section of the image processing apparatus, a scanner (not shown) for reading the specified 
information from the image information printed in the process of the embedding processing section is provided. 
The scanner has an RGB (Blue, Green, Yellow) color separation filter. 

First, in order to surely obtain the specified information by way of separating the stabilizing embedded pat- 

5 tern of the specified information from the image pattern, the image information read throughout plural scanning 
lines is averaged. In this embodiment, data of 128 lines are read out and averaged to derive pixel data of one 
line. In this operation, since a complicated pattern appearing on the image Is not averaged in the main scanning 
direction and an image of the same content is averaged for each sut>-scanning line, specified information can 
be detected with high S/N ratio. However, in this case, it is practically impossible to precisely coincide the scan- 

10 ning direction for reading the original sheet 401 (see FIG. 4) with the actual recording direction and it is often 
the case to set the reading scanning direction at a certain angle with the recording direction. Therefore, if the 
reading scanning direction is set at a certain angle with the recording direction, the effect of the averaging will 
not be reflected. Therefore, a supporting sheet 402 of a larger size than the original sheet 401 is superposed 
on the original sheet 401 as shown in FIG. 4 and then the readout operation is effected. In case of using a 

15 reflectbn-type scanner, after setting the original sheet 401 on the sheet stand of the scanner, a supporting 
sheet 402 is superposed on the original sheet 401. Further, when the original sheet 401 has a white ground, 
a black sheet is used as the supporting sheet 402, and when the original sheet 401 has a black ground, a white 
sheet is used as the supporting sheet 402. Care must be taken to set one side edge of the supporting sheet 
402 in front of the starting position of the reading operation In the main scanning direction. As a result, at the 

20 time of scanning, the starting position of the original sheet 401 is identified depending on whether the scanning 
position is white or black. Therefore, the starting position of the original sheet is detected at each time of scan- 
ning, thus making it possible to enhance the effect of the averaging process. 

Next, the readout process of the specified informatton embedded by the above procedure is explained with 
reference to the flowchart of FIG. 5. 

25 First, the sampling number WIDTH in the main scanning direction and the line number HIGHT in the sub- 
scanning direction are set (step A01). At this time, the sampling number WIDTH in the main scanning direction 
is so set that the width thereof will become smaller than that of the original sheet. For example, the line number 
HIGHT = 128 is set. Assume that the count number in the main scanning direction is n and the count number 
in the sub-scanning direction is m. First, m is set to "0" (step A02) and n is set to "0" (step A03). The n-th total 

30 value Dn which will be described later is set to "0" (step A04). Whether n is equal to "WIDTH - 1 " or not is checked 
(step AOS). If it is "NO". "1" is added to the present value of n (step A06) and then the step A04 is effected 
again. If it is "YES", the next step is effected. 

After this, an RGB signal for one pixel is taken (step A07). the total sum of R, G, B is divided by 3 to derive 
an average value of the RGB signal so as to derive brightness data 10 of the pixel at which n = 0 (step AOS). 

35 Next, n is set to "1" (step A09). In the same manner as described above, an RGB signal for one pixel is taken 
(step A10), the total sum of R, G, B is divided by 3 to derive an average value of the RGB signal so as to derh^e 
brightness data Ip of an n-th pixel (step A11). Next, a difference Al,, between brightness data !„ of the n-th pixel 
and brightness data ln-1 of the (n-l)th pixel is derived (step A12). Whether Ain Is larger than a predetenmined 
threshold value 'TH" or not is checked (step A13). If it is "NO", "1" is added to the present value of n (step A14) 

40 and then the steps A10 to A12 are effected again. If it is "YES", the next step is effected. In this case, if the 
difference AIn = In - ln-1 >s considered as a differential value, an n-th pixel which lies at a point at which the 
differential value varies significantly, that is, Ain takes a value larger than the threshold value TH is used as 
a starting pixel used for actual averaging. An pixel used as a starting pixel is treated as a first pixel before Al^ 
takes a value larger than the threshold value TH. 

45 First, an RGB signal of a starting pixel is taken (step A15). Then, a color difference DDI (where, i: from 1 

to n) between G and B, i.e., color difference component in a G-B direction is derived (step A16). The thus de- 
rived color difference DDI is added to the present total value Dn (at first, Dn = 0). Thus, the total value Dn is 
updated (step A1 7). Next, whether n is equal to "WIDTH" or not is checked (step A1 8). If It is "NO", "1 " is added 
to the present value of n (step A1 9) and the steps A1 5 to A17 are repeated. If it is "YES", the next step is effected. 

50 Next, whether m is equal to "HIGHT - 1" or not is checked (step A20). If it is "NO", "1" is added to the present 
value of m (step A21) and the steps AOS to A1 9 are repeated. If it is "YES", the next step is effected. As a result, 
the total value of color differences DD for the n-th pixels in the respective lines is obtained. 

The present value of n is set to "0" (step A22). The present total value Dn is divided by the line number 
"HIGHT" to derive an average value and the average value is set as Dn (step A23). Next, whether n is equal 

55 to "WIDTH - 1" or not is checked (step A24). If it is "NO", "1" is added to the present value of n (step A25) and 
the step A23 is effected again. If It is "YES", the process is terminated. 
Thus, the average value of the color difference for each pixel is derived. 

After this, in order to extract the frequency component of the pattern representing the specified informa- 
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tion, the derived average value (average value data) of the color difference Is subjected to the filtering process 
by use of a band-pass filter. As a result, the DC component conresponding to the averaged original image in- 
formation is eliminated and only the embedded specified information of a high frequency can be extracted. 
Note that It is also possible to use a high-pass filter instead of the band-pass filter. 
5 The resolution of the scanner Is sufficient if the printed original sheet can be read for each image dot. 
Therefore, If a scanner which can reproduce a nonmal image is used, the specified information can be easily 
extracted according to the above procedure. 

Next, an example of a case wherein the first embodiment of this invention is applied to an ID card having 
a photograph contained therein is explained. When specified information is embedded into an ID card, it is 
10 desirable to overlap a portion of the embedded specified Information on the photograph as shown in FIG. 20A, 
for example. This Is because, in a case that the photograph is changed and the ID card is forged by a third 
party, this fact can be easily discovered. As the specified information embedding range, the ranges shown in 
FIGS, 20B and 20C may be used In addition to the range shown in FIG. 20A 

Embedding of specified information into the !D card or the like is not limited to the first embodiment and 
15 can be applied in the second to tenth embodiments which will be described later. 

As specified Information to be embedded, data capacity of 20 digits at maximum, that is, approx. 65 bits 
Is necessary. For example, an Identification number of typical credit card, which Is represented by larger nunv 
ber of digits than that of any other ID card, is represented by 20 digits (16 digits of card No. and 4 digits of 
secret No.). According to the present invention, however, the above digit number can be sufficiently achieved. 
20 since the present embodiment ensures 72-bit data capacity. 

Further, a larger amount of specified information can be recorded by Including the embedding position of 
the pattern into a portion of the specified information. 

As described above, according to the first embodiment of this invention, a larger amount of specified in- 
formation can be embedded for a smaller unit area without giving unnatural sense of vision. Further, the spe- 
25 cified information can be easily extracted. 

In addition, in the first embodiment, it is possible to directly embedding the specified information into the 
color signals without using the first and second conversion circuits. That is, by substituting the equations (1) 
to (4) Into I, CI, C2, CC2 of the equations (5) to (7), the following equations are obtained. 

r = Y±a/3 (9) 

30 M' = M=Pa/6 (10) 

C = C + a/6 (11) 

Therefore, the second color signals Y', M', C can be obtained from the first color signals Y, M. C with sat- 
isfying the equations (9) to (11). 

It is also possible to embedding different types of specified information for each of 128 tines, since aver- 
35 aging for the 128 lines is effected at the reading time. 

In case of directly embedding the specified Information Into the color signals without using the first and 
second conversion circuit, the embedding processing section is composed as shown in FIG. 22. Like the first 
embodiment, specified information is generated by a code generator 2202 and a pattern signal formed of rec- 
tangular wavefonnn Is generated by a pattern generating circuit 2203. In this case, an amplitude of the pattern 
40 signal which is to be given in the directton of color difference is ± o/Z In a signal converting circuit 2204, the 
pattern signal is converted into a variation signals which is adequate to add on a first color signals Y. M, C 
supplied from a input system 2201 . The variation signals DY, DM, DC to be added to the first odor signals are 
expressed by the following equations. 

DY = ±a/3 (12) 

45 DM = Ta/6 (13) 

DC = + a/6 (14) 

The variation signals obtained by the above equations are supplied to a adder 105 and second color signals 
Y', M', C are obtained. 

It is possible to including the function of the present invention In a general printer, a facsimile machine, or 
50 the like by way of incorporating a medium such as add-on ROM board. In this case, the medium includes a 
code generating/adding section 220a constructed by the code generator 2202, the pattern generating circuit 
2203, the signal converting circuit 2204, and the adder 2205. 

Other embodiments are explained hereinafter. In the other embodiments, with reference to the similar por- 
tions, the same reference numbers are given and detailed explanation thereof is omitted. 
55 In the first embodiment, a variation Is caused In the color difference direction when the specified infor- 

mation is embedded. As is clearly seen from FIG. 3, the merit obtained by giving a variation In the chroma 
direction to embed the specified infomiation is that the visual sensitivity of a man is lower for a variation in the 
color difference (blue - yellow) direction than for a variation in the luminance direction, but the sensitivity is 
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further lower for a variation in the chroma direction than for a variation in the color difference direction. Next, 
the second ennbodinr^ent wherein a variation is given not in the color difference direction but in the chroma di- 
rectton is therefore explained. 

FIG. 6 Is a block diagram showing an embedding processing section In an image processing apparatus 

5 according to the second embodiment of this invention. 

As shown in FIG. 6» an input system 601 is provided in the embedding processing section. First color signals 
Y, M, C corresponding to the recorded color image are supplied from the input system 601 to a first conversion 
circuit 602. The first conversion circuit 602 effects the first converting operation based on the first color signals 
Y, M, C supplied from the Input system 601 so as to create a luminance signal I and two color difference signals 

10 CI, C2. The construction described so far is the same as that in the case of the first embodiment. The lumi- 
nance signal I Is supplied to a second conversion circuit 607 and a pattern generating circuit 606. The color 
difference signal CI is supplied to a first adder 603 and the pattern generating circuit 606. The color difference 
signal C2 is supplied to a second adder 604 and the pattern generating circuit 606. 

Further, like the first embodiment, a code generator 605 is provided in the embedding processing section. 

15 The code generator 605 holds specified infomnation to be embedded in the cdor image, generates the spe- 
cified Information in a coded ioun, and supplies the same to the pattern generating circuit 606. The pattern 
generating circuit 606 generates two pattern signals formed of rectangular waveform based on the code sup- 
plied from the code generator 605 and the luminance signal I and color difference signals C1, 02 supplied 
from the first conversion circuit 602 and supplies the same to the first adder 603 and second adder 604. In 

20 the process of generating pattern signals, the chroma of the image is derived. 

The first adder 603 adds (or subtracts) a pattern signal from the pattern generating circuit 606 to (or from) 
a color difference signal C1 from the first conversion circuit 602. A signal CC1 obtained as the result of addition 
is supplied to the second conversion circuit 607. The second adder 604 adds (or subtracts) a pattern signal 
from the pattern generating circuit 606 to (or from) a color difference signal C2 from the first conversion circuit 

25 602. Asignal CC2 obtained as the result of addition is supplied to the second conversion circuit 607. The second 
conversion circuit 607 effects the second converting operation based on the luminance signal I from the first 
conversion circuit 602, the signal CC1 from the adder 603, and the signal 002 from the adder 604 so as to 
create second color signals Y', M', C. The second color signals Y\ M\ C are supplied to an error diffusion 
processing circuit 608. The error diffusion processing circuit 608 subjects the received second color signals 

30 Y', M', C to the error diffusion process to create an error diffusion pattern. The generated error diffusion pat- 
tern is supplied to an output system 609. The output system 609 is a printer, for example, and outputs an image 
based on the received error diffusion pattern. It is also possible to construct the system without using the error 
diff usk)n processing circuit 608. In this case, the second color signals Y', M', C are directly supplied from the 
second conversion circuit 607 to the output system 609. The output system 609 outputs an image correspond- 

35 ing to the second color signals Y*. M', C 

Next, the operation of the second embodiment is explained. 

First, like the case of the first embodiment, the first color signals Y, M, C corresponding to the color image 
are supplied to the first conversion circuit 602 from the input system 601. In the first conversion circuit 602, 
the first color signals Y, M, C supplied from the input system 601 are converted into the luminance signal I, 

40 color difference signals CI, 02 according to the equations (1) to (3) explained in the first embodiment The 
luminance signal I and the color difference signals CI, C2 are supplied from the first conversion circuit 602 
to the pattern generating circuit 606. 

Further, in the code generator 605, the specified Information is generated in a coded form and supplied 
to the pattern generating circuit 606. Next, in the pattern generating circuit 606, two pattern signals are gen- 

45 erated based on the code. The generated pattern signals are added to the color difference signal 01 in the 
first adder 603 and added to the color difference signal 02 in the second adder 604. In this case, in the pattern 
generating circuit 606. a preset amount of pattern signal having the same component as a vector made by the 
color difference signals CI, 02 is generated. That is. If an amount (amplitude) of specified Informatnn to be 
embedded is expressed by ± a/2, signals 001, 002 obtained after addition of the pattern signals to the color 

50 difference signals 01 , 02 are expressed by the following equations. 

001 = 01 ± a01/(2Cc) (15) 

002 = 02 ± a02/(2Cc) (16) 

Cc expresses the chroma of an Input image. Cc Is derived by the following equatton. 

Cc = SQRT{(C1)2 + (02)2} (17) 
55 The procedure effected after this to derive the second color signals Y', hA\ C to be supplied to the output 
system is the same as in the first embodiment. 

Since both of the color difference signals CI , 02 are "0" when an input image is a nrwnochromatic image, 
the chroma direction for most of the Image dots In the Image plane cannot be determined. Therefore, it becomes 
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difficult to embed the specified information. In order to solve this problem, the process is changed to embed 
the specified information in the color difference direction of Y>M in a case where both of the color difference 
s^nals C1. C2 are kept within a preset range and an input image is regarded as a monochromatic Image. That 
is, the distribution of the chroma Cc in the image plane is derived, and if the range of the distribution remains 
5 within a preset range, the color difference signal C1 is kept unchanged and only the color deference signal C2 
is changed. That is, a signal CC2 obtained after the pattern signal is added to the color difference signal C2 
is expressed by the following equation. 

CC2 = C2±a/2 (18) 

The process expressed by the equation (18) is the same as that in the case of the first embodiment. 
10 Alternatively, it is possible to prevent the process for embedding the specified Information from being ef- 
fected in a case where both of the color difference signals CI, C2 are kept within a preset range and an Input 
image is regarded as a monochromatic image. 

Further, the human eyes sometimes become sensitive to a color near the achromatic color. Therefore, If 
the specified information is not embedded in a portion near the achromatic color, it becomes possible to make 
15 It difficult for a man to identify the specified information. 

It is necessary to set the amplitude and period of the embedded specified information by taking the limit 
of the visual sense of a man into consideration. In this case, a pattern appearing on the image plane becomes 
less significant to the human eyes as the amplitude thereof is smaller and the period thereof is shorter. 

Further, as is clearly understood from FIG. 3 which is explained in the first embodiment, there is no pos- 
20 sibility that the pattern will be identified by the human eyes even if the amplitude is set to a relatively large 
value. Since the amplitude of the pattern itself Is large, the possibility that it Is erased by noises is low. There- 
fore, even If a sensor with high S ratio is not used, the pattern can be easily extracted. 

The signal CC1 created by the adder 603 is supplied to the second conversion circuit 607. Further, the 
signal CC2 created by the adder 604 is supplied to the second conversion circuit 607. Then, the luminance 
25 signal I, color difference signal C1 and signal CC2 are converted into second color signals Y', M', C by the 
second conversion circuit 607. In this case, the conversion is effected according to the equations (5) to (7) as 
explained in the first embodiment. In this conversion, It Is considered that C1 in the equations (5) to (7) Is re- 
placed with CC1. 

Thus, an image having the specified infonmation embedded therein is obtained. 
30 The thus derived second color signals Y', M', C are supplied to the error diffusion processing circuit 608. 
In the error diffusion processing circuit 608, an error diffusion pattern is created. 

In the output system 609, as shown in FIG. 2B, 9-byte data con-esponding to the specified infonmation Is 
repeatedly embedded in the main scanning direction and precisely the same pattern is repeatedly embedded 
in the sub-scanning direction. Thus, the specified InfonfDation Is embedded in the image information and print- 
35 ed. 

Now, the technique for permitting a large amount of specified information to be embedded is explained. 
With this technique, the amount of specified Information to be embedded Is controlled and changed according 
to the chromaticity of an input image. 

FIG. 7 is a schematic diagram showing the distributbn of the sensitivity of an observer to the respective 
40 chromaticities for a pattern of the same period obtained as the result of study thereon. In FIG. 7, the color dif- 
ference is taken on the abscissa and the luminance is taken on the ordinate. The area in which the painted 
color is lighter indicates the higher sensitivity. As is clearly seen from FIG. 7, when a pattern is embedded in 
a portion which has the low color difference and the intemr^ediate luminance, the pattern can be relatively easily 
identified by the human eyes. Therefore, it is necessary to effect the control so as to prevent the pattern from 
45 being embedded in a color of high-sensitivity chromaticity area corresponding to the core which Is not painted, 
or suppress the amplitude of the pattern in this area and enlarge the amplitude of the embedded pattern as 
the sensitivity becomes lower. 

In this case, a memory (not shown) for storing amplitude coefficients for determining the amount of addition 
of pattern signals is provided in the pattern generator 606 shown in the block diagram of FIG. 6. The pattern 
50 generator 606 fetches an adequate amplitude coefficient from the memory according to the luminance signal 
I and color difference signals C1 , C2 supplied from the first conversion circuit 602. At this time, an LUT (Look 
Up Table) is referred to, for example. Then, the pattern generator 606 changes the amplitudes of the pattern 
signals to be respectively added to the color difference signals C1, C2 according to the amplitude coefficient 
fetched from the memory. That is, the pattern generator 606 generates pattern signals so as to prevent the 
55 pattern signals from being added in a high-sensitivity area near the achromatic color or suppress the amplitude 
thereof to a small value. Thus, the pattern signals are added to the color difference signals C1 and C2 in the 
adders 603 and 604, respectively. If the amplitude coefficient is expressed by the color difference signals 
CC1 , CC2 are expressed by the following equations. 
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CC1 = C1 ±apC1/(2Cc) (19) 
CC2 = C2±apC2/(2Cc) (20) 
As a result, it becomes possible to embed a larger amount of specified information and make it more dif- 
ficult to visually identify the embedded specified information. 
5 Next the process for reading out specified information output in the above procedure is explained. 

In the readout processing section of this apparatus, a scanner (not shown) for reading specified infonna- 
tion from an image printed by the process of the above embedding processing section is provided. The scanner 
has an RGB (Blue, Green, Yellow) color separation filter mounted thereon. 

The specified information reading process is similar to that of the first embodiment. However, the process 
10 Is partly different from the process explained in the first embodiment. Referring to FIG. 5, a color difference 
DD (color difference component in the G-B direction) between G and B is derived in the step A16 of the first 
embodiment. On the other hand, in the step A1 6 of the second embodiment, the chroma DD Is derived by cal- 
culating SQRT{(G- B)2 + (R - B)2}. Further, in the first embodiment, the color difference DD is added to the 
total value Dn in the step A17. On the other hand, in the second embodiment, the chroma DD is added to the 
IS total value Dn in the step A1 7. The procedure other than the above steps is the same as that of the first em- 
bodiment As a result the average of color differences for the respective pixels can be derived. 

After this, the derived average of chroma (average value data) is subjected to the filtering process by a 
band-pass filter in order to extract the frequency component of the pattern. As a result the DC component 
that is, the averaged original image infonnation is eliminated and only the embedded specified information 
20 can be extracted. 

The resolution of the scanner is sufficient if the printed original can be read for each image dot Therefore, 
if a scanner which can reproduce a nonnal image is used, the specified information can be easily extracted 
according to the above procedure. 

As described above, according to the second embodiment, it becomes possible to make It more difficult 
25 to visually identify the specified information and embed a larger amount of specified information in comparison 
with the first embodiment. Further, the specified information can be easily extracted. 

In addition, in the second embodiment, it is possible to directly embedding the specified Information into 
the color signals without using the first and second conversion circuit That is, the second color signals V, M', 
C can be derived from the first color signals Y, M. C using the equatktns (1) to (3), (5) to (7), and (15) to (1 7). 
30 In this case, the variation signals DY, DM, DC (being generated by the signal generating circuit 2204 in FIG. 
22) to be added to the first color signals are expressed by the following equations. 

DY = ± a(2Y . M - C)/{6.SQRT((M - C)2 + (Y - M)2)} (21) 
DM = ± a(2M - C - Y)/{6'SQRT((M - C)2 + (Y - M)2)} (22) 
DC = ± a(2C - Y - M)/{6.SQRT((M - C)2 + (Y - M)2)) (23) 
35 Next a third embodiment is explained. 

Generally, when a small variation is gh^en to a portion in which a variation in the density of an image is 
even, the corresponding portion becomes visually significant, but when a variation is given to a portion in which 
a variation in the density is large, the corresponding portion will not become visually significant. In this em- 
bodiment this property is utilized. That is, when a variation in the density of the image is large, specified in- 
40 formation is intensely embedded, and specified information is weakly embedded in a portton in which a vari- 
ation in the density is even. 

FIG. 8 is a block diagram showing an embedding processing section in an image processing apparatus 
according to a third embodiment of this invention. 

As shown in FIG. 8, an input system 801 is provided In the embedding processing section. First color signals 
45 Y, M, C, K(black) corresponding to the recorded color image are supplied from the input system 801 to a first 
conversion circuit 802. The first conversion circuit 802 effects the first converting operation based on the first 
color signals Y, M, C, K supplied from the input system 801 so as to create a luminance signal I and two color 
difference signals CI , C2. The luminance signal I is supplied to a second conversion circuit 809, high frequency 
extracting circuit 807 and pattern generating circuit 806. The color difference signal C1 is supplied to a first 
50 adder 803 and the pattern generating circuit 806. The color difference signal C2 is supplied to a second adder 
804 and the pattern generating circuit 806. 

Further, a code generator 805 is provided in the embedding processing section. The code generator 805 
holds specified information to be embedded in the color image, generates the specified infonnation in a coded 
form, and supplies the same to the pattern generating circuit 806. The pattern generating circuit 806 generates 
55 a pattern signal of rectangular waveform, as shown in FIG. 2A, based on the code supplied from the code gen- 
erator 805 and the luminance signal I and color difference signals CI , C2 supplied from the first conversion 
circuit 802 and supplies the same to multipliers 808a and 808b. The high frequency extracting circuit 807 ef- 
fects the high frequency component extracting process which is well known in the art In response to the lumi- 
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nance signal I supplied from the first conversion circuit 802, derives a coefficient k for determining the ampli- 
tude of the pattern signal according to the Intensity of the high frequency component and supplies the same 
to the multipliers 808a and 808b. The multiplier 808a multiplies the pattern signal from the pattern generating 
circuit 806 by a coefficient k from the high frequency extracting circuit 807 and supplies an output to the first 
5 adder 803. Similarly, the multiplier 808b multiplies the pattern signal from the pattern generating circuit 806 
by a coefficient k from the high frequency extracting circuit 807 and supplies an output to the second adder 
804. 

The first adder 803 adds (or subtracts) a signal from the multiplier 808a to (or from) a color difference 
signal C1 from the first converston circuit 802. A signal CC1 obtained as the result of addition is supplied to 

10 the second conversion circuit 809. The second adder 804 adds (or subtracts) a signal from the multiplier 808b 
to (or from) a color difference signal C2 from the first conversion circuit 802. A signal CC2 obtained as the 
result of addition Is supplied to the second conversion circuit 809. The second conversion circuit 809 effects 
the second converting operation based on the luminance signal I from the first conversion circuit 802, the signal 
CC1 from the adder 803, and the signal CC2 from the adder 804 so as to create second color signals M', 

IS C. The second color signals Y\ M', C are supplied to an error diffusion processing circuit 810. The error dif- 
fusion processing circuit 810 subjects the received second color signals Y', M\ C to the error diffusion process 
to create an error diffusion pattern. The generated error diffusion pattern is supplied to an output system 811 . 
The output system 811 is a printer, for example, and outputs an image based on the received enror diffusion 
pattern. 

20 Next, the operation of the third embodiment is explained. 

First, the first color signals Y, M. C, K corresponding to the color image are supplied to the first conversion 
circuit 802 from the input system 801. In the first conversion circuit 802, the first color signals Y, M,C, Ksupplied 
from the input system 801 are converted into the luminance signal I and color difference signals CI, C2. The 
luminance signal I and the color difference signals C1, C2 are supplied from the first conversion circuit 802 
25 to the pattern generating circuit 806. In this case, the conversion from the first color signals Y, M, C, K to the 
luminance signal I and color difference signals CI, C2 is effected according to the following equations. 

I = 1 - ((Y + M + C)/3 + K) (24) 
C1 = M - C (25) 
C2 = Y - M (26) 

30 In the code generator 805, specified information is generated in a coded fbnm and supplied to the pattern 
generating circuit 806. Next, in the pattern generating circuit 806, two pattern signals are generated based on 
the above code. In this case, in the pattern generating circuit 806, a preset amount of pattern signal having 
the same component as a vector made by the color difference signals C1, C2 is generated. Further, the con- 
version relation between the color difference signals obtained before and after the specified information is 

35 embedded is the same as that expressed by the equations (15) to (17) explained in the second embodiment. 
Like the case of the second embodiment, the pattern generating circuit 806 contains a memory (not shown) 
for storing amplitude coefficients for determining the amount of addition of pattern signals. The pattern gen- 
erator 806 fetches an adequate amplitude coefficient from the memory according to the luminance signal 1 
and color difference signals CI , C2 supplied from the first conversion circuit 802. At this time, an LUT is referred 

40 to, for example. Then, the pattern generator 806 changes the amplitudes of the pattern signals to be respec- 
tively added to the color difference signals CI , C2 according to the amplitude coefficient fetched from the mem- 
ory. That is, the pattern generating drcuit 806 generates pattern signals so as to prevent the pattern signals 
from being added in a high-sensitivity area near the achromatic color, for example, or suppress the amplitude 
thereof to a small value. 

45 The amplitude of the generated pattern signals are further controlled in the multipliers 808a and 808b by 
the coefficient k from the high frequency extracting circuit 807 and then the pattern signals are supplied to 
the first adder 803 and second adder 804. In this case, if a less high frequency component is extracted, for 
example, the amplitude is suppressed to a small value by the coefficient k. The pattern signal after multipli- 
cation Is added to the color difference signal CI in the first adder 803 and to the color difference signal C2 in 
50 the second adder 804. Then, in the second conversion circuit 809, the color signals Y', M', C, K' to be supplied 
to the output system are derived. 

In this case, conversion into the second color signals is effected according to the following equations, 
r = 1 - (I + K) + (CC1 + 2.CC2)/3 (27) 
M' = 1 - (I + K) + (CC1 - CC2)/3 (28) 
55 C' = 1 - (I + K) - (2 CC1 +.CC2)/3 (29) 

Thus, the second color signals Y', M', C. IC representing a color image into which specified infonrrtation 
is embedded can be obtained. 

After this, they are subjected to the pseudo-half tone representation process in the error diffusion proc- 



12 



EP 0 642 060 A2 



essing circuit 810 and output to the output system 811. 

The specified information reading procedure is the same as that in the first embodiment 
As described above, in the third embodiment, the amplitude of a pattern to be embedded is made large 
in a portion of an Image in which a large amount of high frequency component lies and a variation is significant, 
5 and the amplitude of a pattern to be embedded is made small in a portion of the image in which only a small 
amount of high frequency component lies and a variation is less significant. As a result, it becomes possible 
to make it more difficult to visually identify the embedded specified infomnation and embed a larger amount 
of specified information in comparison with a case of the second embodiment Further, the specified informa- 
tion can be easily extracted. 

10 In the present invention, It is not always necessary to vary the amplitude in accordance with visual sen- 
sitivity. 

In addition, in the third embodiment, it is possible to directly embedding the specified information into the 
color signals without using the first and second conversion circuit That is, the second color signals Y*, M', C, 
K' can be derived from the first color signals Y, M, C, K using the former equations. In this case, the variation 
15 signals DY, DM, DC, DK (being generated by the signal generating circuit 2204 in FIG. 22) to be added to the 
first color signals are expressed by the following equations. 

DY = ±a/3 (30) 
DM = +a/6 (31) 
DC = T a/6 (32) 
20 DK = 0 (33) 

Next, a fourth embodiment is explained. 

In the first embodiment, a case where primaries Y, M, C of substructive mixture are used is explained. In 
this fourth embodiment, a case where primaries R, G, B of additive mixture are used is explained. The fourth 
embodiment is the same as the first embodiment except for color primaries of color signals. That is, in FIG. 1 , 
25 first color signals R, G, B (not Y, M. C) are supplied from the input unit 101 to the first conversion circuit 102, 
and second color signals R', G', B' (not Y*. M', C) are supplied from the second conversion circuit 106 to the 
error diffusion processing circuit 107. 

The conversion from the first color signals R, G, B to the luminance signal I and color difference signals 
CI, C2 is effected according to the following equations. 
30 I = (R + G + B)/3 (34) 

CI = R - G (35) 
C2 = G - B (36) 

Next, the color difference signal CC2 added the pattern signal can be expressed by the above equation 

(4). 

35 In this case, the conversion into the second color signals is effected according to the following equations. 

R* = I + (2C1 + CC2)/3 (37) 
G' = I + (-C1 +CC2)/3 (38) 
B' = I + (.C1.2.CC2)/3 (39) 
Thus, the second color signals R', G', B' representing a color image into which specified information Is 
40 embedded can be obtained. 

In addition, in the fourth embodiment, it is possible to directly embedding the specified Information into 
the color signals without using the first and second conversion circuits. That is, the second color signals R', 
G*, B' can be derived from the first color signals R, G, B using the former equations, in this case, the variation 
signals DR, DG, DB (being generated by the signal generating circuit 2204 In FIG. 22) to be added to the first 
45 color signals are expressed by the following equations. 

DR = ±a/6 (40) 
DG = ±a/6 (41) 
DB = a/3 (42) 

Next, a fifth embodiment Is explained. 

50 In the second embodiment, a case where subtractive primaries Y, M, C are used is explained. In this fifth 
embodiment, a case where additive primaries R, G. B are used is explained. The fifth embodiment is the same 
as the second embodiment except for color primaries of color signals. That is, in FIG. 6, first color signals R, 
G. B (not Y, M. C) are supplied from the input unit 601 to the first conversion circuit 602, and second color 
signals R', G*, B' (not Y*, M*, C) are supplied from the second conversion circuit 607 to the error diffusion proc- 

55 essing circuit 608. 

The conversion from the first color signals R, G, B to the luminance signal I and color difference signals 
CI. C2 is effected according to the above equations (34) to (36). 

The signals CC1 , CC2 obtained after addition of the pattern signals to the color difference signals CI , C2 
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are expressed by the above equations (15) to (17). 

In this case, the conversion into the second color signals is effected according to the following equations. 

R' = I + (2CC1 + CC2)/3 (43) 
G' = I + ( - CC1 + CC2)/3 (44) 
B' = I + (-CC1 -2CC2)/3 (45) 
Thus, the second color signals R'. G', B* representing a color image into which specified information is 
embedded can be obtained. 

In addition, in the fifth embodiment, it is possible to directly embedding the specified information into the 
color signals without using the first and second conversion circuits. That is, the second color signals R', G', 
B' can be derived from the first color signals R, G. B using the former equations. In this case, the variation 
signals DR. DG, DB (being generated by the signal generating circuit 2204 in FIG. 22) to be added to the first 
color signals are expressed by the following equations. 

DR = ± a(2R - G - B)/{6 SQRT((R - G)2 + (G - B)2)} (46) 
DG = ± a(2G - B - R)/{6.SQRT((R - G)2 + (G - B)2)} (47) 
DB = ± a(2B - R - G)/{6*SQRT((R - G)2 + (G - B)2)} (48) 
In the first to fifth embodiment, quite the same specified information is embedded in the sub-scanning 
direction. It is also possible to embedding different types of patterns for each of 128 lines so as to increase a 
amount of the specified infonmation to be embedded, since averaging for the 128 lines is effected at the reading 
time. Further, a unit of the specified information is not limited to 7 bites and any number of bite can be taken. 
Next, a sbcth embodiment is explained. 

In the above embodiments, a striped pattern which is obtained by varying amplitude of unage data in ac- 
cordance with the data to be embedded is superposed on a image. In the present embodiment, a plurality of 
frequency components on a two-dimensional Fourier transform plane are multiplexed in accordance with spe- 
cified information data and a two-dimensional moire pattern having the multiplexed frequency components 
are added to a color image signal. 

FIG. 9 is a block diagram showing an embedding processing section in an image processing apparatus 
according to the sixth embodiment of this invention. 

As shown in FIG. 9, an input system 901 is provided in the embedding processing section. First color signals 
Y. M. C corresponding to the color image are supplied from the input system 901 to a first conversion circuit 
902. The first conversion circuit 902 effects first converting operation based on the first color signals Y, M, C 
supplied from the input system 901 so as to create a luminance signal I and two color difference signals C1, 
C2. The first converting operation is the same as that in the first embodiment. The luminance signal I Is supplied 
to a second conversion circuit 908. The color difference signal CI which is one of the above two color difference 
signals C1, C2 is supplied to the second conversion circuit 908 and the color difference signal C2 is supplied 
to the second converting circuit 908 via a band elimination circuit 903 and an adder 907. The band elimination 
circuit 903 executes moving average process with 8 x 8 for the color difference signal C2 from the first con- 
version circuit 902 so as to eliminate information other than the image infomDation. That is. the band eliminating 
operation is a low pass filter operation, in which only the image information components dose to DC component 
can be extracted, this is because a specified infonmation (having high-frequency component) may have been 
already embedded into the image signal supplied from the input system 901 by way of the present embedding 
process. 

Further, a code generator 904 is provided in the embedding processing section. The code generator 904 
holds specified information to be embedded in the color image, generates the specified information in a coded 
form, and supplies the same to an information processing section 905. The information processing section 905 
processes a code supplied from the code generator 904 for encipherment or compression and supplies the 
result of processing to a pattern generating circuit 906. The pattern generating circuit 906 generates a pattern 
signal based on a code supplied from the infbnnation processing section 905 and supplies the same to the 
adder 907. 

The adder 907 adds (or subtracts) a pattern signal from the pattern generating circuit 906 to (or from) a 
color difference signal C2 from the band elimination circuit 903. A signal CC2 obtained as the result of addition 
is supplied to the second conversion circuit 908. The second conversion circuit 908 effects the second con- 
verting operation based on the luminance signal I. the color difference signal CI supplied from the first con- 
version circuit 902 and the signal CC2 supplied from the adder 907 so as to create second color signals Y', 
M*. C\ The second color signals Y\ M'. C are supplied to an output system 909. The output system 909 is, for 
example, a printer, a facsimile equipment, or a color copy machine, and outputs a color image based on the 
received second color signals Y*, M', C. 

Next, the operation of the swth embodiment is explained. , 

First, the in put first color signals Y, M. C are converted into a luminance signal I and color difference signals 
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CI. C2. The conversion in this case are based on the equations (1) to (3). The color signals are expressed by 
a value ranging from 0 to 1, a case of Y=M=C=0 indicates white and a case of Y=M=C=1 indicates black. 

Assume now that an input original or image data has specified information previously recorded therein by 
the technique based on the present embodiment. In this case, it is necessary to eliminate old information from 

5 a printed original or image data and extract only original image data. That is, the moving average of e.g. 8 x 
8 for the color difference signal C2 is derived, and the value thereof is newly set as an image signal of C2 so 
as to extract only the color image signal. The number of pbcels subjected to the averaging process depends 
on the number of pixels of the printer. Alternatively, it is possible to obtain only Image data by effecting the 
Fourier transform in the color difference direction, extracting the embedded specified infonnation, and elim- 

10 inating only the extracted frequency component 

The specified information is embedded into this image data by the adder 907 and the second color signals 
Y', M', C are supplied to the output system 909 via the second conversion circuit 908. The conversion of the 
signals 1, C1, C2 into the second color signals Y*. M*. C is effected according to the equations (5) to (7) ex- 
plained in the first embodiment 

15 Next, the process of embedding specified infonmation is explained. The specified Infonmation is expressed 
by a numeric value such as code, which is the same as in the first embodiment The value is previously sub- 
jected to the process such as encipherment or compression in the Information processing section 905. As is 
clearly seen from FIG. 2 which Is refenred to In the first embodiment, the gradation identifying ability of a man 
is high for a variation in the luminance direction and low for a variation in the color difference (Y-M) direction. 

20 Also, in this embodiment, this property is utilized to embed specified information. 

As shown In FIG. 10A, a Fourier transform plane constructed by the main scanning direction axes and the 
sub-scanning direction axes is defined so as to generate pattern signal of moire pattern which has multiplexed 
frequency components. The Fourier transform plane has a plurality of points which are arranged thereon in 
accordance with some fixed rules and are corresponding to each bit data. Each of the points is given a period 

25 and an amplitude. By adding the period and the amplitude for each bit data, the embedded pattern is generated. 
The code which Is effected a process such as encipherment or compression by the infonmation processing 
section 905 is supplied to the pattern generating circuit 906. When the code is supplied to the pattern gener- 
ating circuit 906, the plurality of bits forming the code are sequentially anranged on the predetermined points 
of the Fourier transform plane. In this case, arranging point and order can be arbitrarily determined. In this 

30 embodiment, each bit Is anranged with keeping a certain distance on a plurality of lines which are radially ex- 
panded. That is, the arranging points of bits draws a concentric circle whose center is set on the origin of the 
coordinate axes. If an angle made by the above line and the main scanning direction axes Is expressed by 0, 
the value of the angle 0 is given in the range of 0 ^ 9 < ic, and if the range is divided by n. 0 = k/n n (k = 0 to 
n-1). In this case, n (a number of divisions) can be set to a lariger value as the period Wt becomes smaller. 

35 That is, n can be set to a larger value, as the period becomes closer to 2 dot/cycle corresponding to the Nyqulst 
frequency. Each bit Is arranged between the point corresponding to the limit of eyesight and the point corre- 
sponding to the Nyquist frequency, with keeping a certain distance each other on each radial line. 

In the Fourier transform plane, the period indicates a distance between the origin and the bit arranged point. 
The period becomes longer, as the point becomes closer to the origin. The period becomes shorter, as the point 

40 becomes far from the origin. The Nyquist frequency corresponds to the upper bound of the high-frequency 
component which can be expressed by the printer. 

In order to specify a starting point for arranging bits. In the range of the limit of eyesight, as shown In FIG. 
1 0A, bits except one bit are always set ON or OFF (In the sample of FIG. 1 0A, bits except one bit are set always 
OFF: 0) with no relation to the specified Information. Bit S expressed by a white circle in which S is written Is 

45 an-anged on one exceptional point The bit S is ahvays set ON or OFF (in the sample of FIG. 1 0A, bit set always 
ON: 1), The thus bit S which is distinguished from another bits in the limit of eyesight Is the starting bit (i.e., 
the starting bit for arranging another each bit of code data). 

The bits are sequentially arranged in the radiating direction on one radlatlnal line. If the arranged bit reach- 
es the point corresponding to the Nyquist frequency, then 9 is reduced and remaining bits are similarly ar- 

50 ranged on the next nadiational line. The numbers 1 to 8 ... in the circles of bits of FIG. 10A indicate arranging 
orders. It is possible to arrange bits in order either from the most-significant-bit or from the least-significant- 
bit 

Thus, on the Fourier transform plane, a bit for identification of the starting point (i.e., a starting bit S being 
independent on the specified information) Is always set ON (or OFF) in a low-frequency range which is less 
55 subject to deterioration, for example. Further, other examples of the start bit S are shown In FIGS. 10B and 
100. In either case, the arrangement In the limit of eyesight on the Fourier transform plane is shown, as a va- 
riation of FIG. 10A. Unlike the case of FIG. 10A. in a case of FIG. 10B, the starting bit S is always set OFF 
and the other bits are always set ON. In a case of FIG. 100, all of the bits are always set ON and only the 
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amptitude Wl of the point (shown as white double circle) corresponding to the start bit is emphasized (e.g.. 
doubted) so as to distinguish from other bits in the limit of eyesight 

The period and the amplitude of all bit data of the specified information arranged on the Fourier transform 
plane are added to the color image signal, in accordance with the pbcel position x. y of the color image, on 
5 which the specified infonnation is to be embedded. 

The pattern generating circuit 906 thus generates specified Information pattern 2Zp(9,WL). XS means the 
sum relative to 9 (0 ^ 0 < 180°) and WL (period varying in the range between the limit of eyesight and the 
Nyquist frequency). 

22p(e,WL) = (WI/2)cos(cosex.2ji/WL + siney-2n/WL) (49) 
10 In this case. WI/2 indicates an amplitude of each bit If the bit indicates 0. then Wl=0 and only the component 
of the bit indicating 1 is added. Therefore, CC2 of the output from the adder 907 is expressed by the following 
equation. 

CC2 = C2 + 2:ip(e,WL) (50) 
Next, the procedure for determining values of period WL, angle 9, and amplitude Wl is explained. First. 

15 roughly speaking, the period WLIies in the range between the "limit of eyesight' in the color difference direction 
in which specified information is to be embedded and the Nyquist frequency of the printer. However, the "limit 
of eyesight" Is used for convenience and actually indicates the frequency of a point at which the sensitivity to 
a variation in the density abruptly drops. The "limit of eyesight" is a value which does not depend on the printer. 
The limit of eyesight in the color difference (Y-M) direction is e.g. 2 cycle/mm. Now. an attempt is made to derive 

20 a controlled variable of the printer corresponding to the above value. For example, If the printer used has a 
resolution of 400 dpi. one period of the limit of visual sense corresponds to approximately 8 pixels. Therefore, 
when the printer of the above resolution is used, the range of the period WL corresponds to 2 to 8 pbcels. in 
this case, the period corresponding to 2 pixels implies the limit value which can be expressed by the printer. 
The value of the amplitude Wl is set by taking the MTF (nrKXiulation transfer function) characteristic of the 

25 output system and the visual sense for the periodic structure into consideration. That is, the identifying ability 
shown in FIG. 2 is referred to. For example, the value of the amplitude Wl is set to a larger value as the conn- 
ponent has a higher frequency such that Wl Is set to 1/64 if the period WL is equal to eight pixels, and Wl is 
set to 1/4 if the period WL is equal to two pixels, thus enhancing the data efficiency. This is because the fact 
that the high-frequency component is influenced by the MTF characteristic of the output system and tends to 

30 be degraded is taken into consideration. 

In addition, the number of divisions and the range of the period of the embedded pattern depend on the 
gradation number which can be expressed by the output system, the S ratio of the reading system or the like, 
the number of sampling pixels at the reading time and the like. Further, the angle (or the number of divisions) 
depends on the S ratio of the reading system or the like, the number of sampling pbcels at the reading time 

35 and the like. 

In this embodiment, a case wherein the period and angle are set at regular intervals on the Fourier trans- 
form plane is explained, but the arrangement is not necessarily made at regular intervals if a problem that it 
is difficult to attain data matching at the time of reading embedded specified information or the like does not 
occur. That is. although a concentric circle Is drawn in the present embodiment, it Is also possible to draw a 

40 concentric ellipse but an entire circle. 

Most of the general color originals do not contain periodic components of high frequency in the color dif- 
ference component. However, in some rare cases, the periodic component is contained in a line drawing or 
dot image. When specified information is embedded In such an image, a component which is not actually em- 
bedded is erroneously regarded as being embedded at the time of reading in some cases. In this case, erro- 

45 neous determination can be prevented by treating a plurality of components as one bit That is. at least one 
dummy bit having the same content as that of another bit is provided. In this case, the amount of specified 
information which can be embedded is reduced in accordance with the number of dummy bits. 

FIGS. 11 A and 11 B indicate the bit anrangement on the Fourier transform plane based on the above- 
described concept. In order to simplify the explanation, bits set always OFF are omitted in FIGS. 11 A and 11 B. 

50 A bit having the same number as that of another bit is identified to have the same content. In this case, the bit 
whose number is attached with dash is the dummy bit. FIG. 11 A indicates an example In which the same bit 
is arranged on adjacent radially extending lines (two components are treated as one unit). That is. the bits in 
one line are arranged in the regular order and the bits in the other line are anranged in the reverse order. FIG. 
1 1 B indicates an example in which three lines are treated as one block and the same bit is anranged in the unit 

55 of block (two dummy blocks are anranged for one block). In either case, it Is preferable that the same bit is not 
arranged on one radially extending line or the same circumference. Further, when two components are treated 
as the same bit it is preferable that the averaging is effected and the threshold process is effected at the read- 
ing time to check the presence or absence of the bit If two or more dummy bits are used (three or more the 
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same bits are used), a procedure of majority decision may be taken. 

By treating the bit in the above-described manner, the enroneous determination at the time of reading can 
be prevented. For example, if an original is a dot image or line drawing, high-frequency components may some- 
times occur in the color difference direction and error determination Is made. In order to alleviate this, a plurality 
5 of components are treated as one unit 

In this embodiment, it is also possible to directly embed specified Information into the second color signals 
Y\ M\ C without using the first conversion circuit 902 and the second conversion circuit 908 as follows. 

In case of directly embedding the specified information into the color signals without using the first and 
second conversion circuit, the embedding processing section is composed as shown in FIG. 23. Like the fourth 
10 embodiment, specified infomrtation is generated by a code generator 2303 and a pattern signal is generated 
by a pattern generating circuit 2304. In this case, an amplitude of the pattern signal which is to be given in the 
direction of color difference is p. In a signal converting circuit 2305, the pattern signal is converted Into a va- 
riation signals which Is adequate to add on a first color signals Y, M, C supplied from a input system 2301 . The 
variation signals DY, DM. DC to be added to the first color signals are expressed by the following equations. 
15 In this case, the procedure of calculating an amount p of the period component to be arranged Is the same 
as described before. 

DY = + (Xip)2/3 (51) 
DM = - (Iip)/3 (52) 
DC = - (ZSp)/3 (53) 

20 The variation signals obtained by the above equattons are supplied to a adder 2306 and second color sig- 
nals Y', M*. C are obtained. 

It Is possible to including the function of the present invention in a general printer, a facsimile machine, or 
the like by way of incorporating a medium such as add-on ROM board. In this case, the medium Includes a 
code generating/adding section 230a constructed by the code generator 2303, the pattern generating circuit 
25 2304, the signal converting circuit 2305, and the adder 2306. 

Next, the process of reading specified information printed in the above-described procedure is explained. 
For the reading of specified infonmation, a scanner having an RGB (Blue, Green, Yellow) color separation 
filter is used. 

Now. the process of extracting specified information is explained with reference to the flowchart of FIG. 

30 12. The size to be extracted Is sufficient if it is 64 x 64 pixels. For example, the above size can be expressed 
by 4 X 4 mm In terms of 400 dpi and it Is only necessary to use a portion of the image. In other words, in the 
present embodiment, the specified information pattern may be superposed on only a portion of the region, if 
the region has been known. First, an RGB signal is input (step B01). The division number n for the averaging 
is set (step B02). The number m is set to 1 (step BOS). The reading starting position and reading size are set 

35 (step B04). An area to be read is defined (step B05). In order to extract only the color difference (G - B) among 
the input RGB signal, DD = G - B is set (step B06). In this case, G is a complementary color of M and B is a 
complementary color of Y. The two-dimensional Fourier transfomn Is effected (step B07), and the start bit pos- 
ition is determined based on the component of a frequency (2 cycle/mm) of the limit of visual sense (step BOS). 
The presence or absence of the above component in each bit is determined based on the start position, each 

40 bit is set to "0" when the component is not detected, and is set to "1" when the component is detected, and 
thus the input data is determined (step B09). Next, whether m is equal to the division number n or not is checked 
(step BIO). If it is "NO", "1" is added to m (step B11) and the steps B14 to 809 are repeated. If it is "YES", the 
next step is effected. In order to enhance the reliability of data, a plurality of areas are sampled and the sampled 
values are averaged for each frequency component on the Fourier transform plane (step B12). Further. If nec- 

45 essary at this time, an area to be sampled is enlarged. Further, the threshold process is effected to determine 
whether the bit is present or absent (step B1 3). Then, the specified information is calculated (step B14). When 
the readout data is encoded, the decoding process is effected, and when it is compressed, the expansion proc- 
ess Is effected (step B15). 

In the above process, in case that dummy bits are not provided in the Fourier transfonn plane, I.e., in case 

50 that every.bit is given differing infonmation in the Fourier transform plane, steps B2. B3, B10, B11. and B12 
are omitted. 

As described above, according to the sixth embodiment, it is possible to prevent occurrence of unnatural 
sense of vision even if a large amount of spedf led infonmation is embedded. Even if the image is inclined to 
some extent at the reading lime, frequency components are precisely detected without making erroneous de- 
55 termination. 

In the sixth embodiment, the case wherein the specified information is embedded in the color difference 
direction is explained. However, it is possible to modify to the case of embedding in the chroma direction or 
the case of varying the amplitude of the embedding pattern in accordance with high-frequency component of 



17 



EP 0 642 060 A2 



visual sensitivity or luminance. 

Next, a seventh embodiment is explained. 

I n the sixth emt}odiment, a case wherein frequency components are arranged in a circular form or elliptical 
form on the Fourier transform plane is explained. On the other hand, in the seventh emt)odiment, a case where- 
5 in the components are arranged in a lattice form is explained. 

The general procedure of embedding specified infonmation is the same as that explained in the sixth em- 
bodiment Further, the embedding processing section in this embodiment has the same construction as that 
of FIG. 9 used in the sixth embodiment. However, the process in the information processing section 905 is 
different tike the case of the sixth embodiment, it is also possible to directly embed specified infonmation 
10 into color signals without using the first and second conversion circuits. 

First, as shown in FIG. 13, periodic components are arranged in a lattice form on the Founer transform 
plane. When the period in the main scanning direction is Wt1 and the period in the sub-scanning direction is 
Wt2, the equation expressing the amount of the periodic components to be arranged is as follows. Implies 
the sum expressed in terms of Wtl, Wt2. 
IS 22:p(Wt1 , Wt2) = (WI/2)cos(x.2nWt1 + y-2n/Wt2 + p(WL1 , Wt2)) (54) 

In this case, p indicates a phase shift which varies in the range of 0 ^ p < 27i and the value thereof is 
changed for each frequency component to reduce the influence by superposition of the pixels. However, when 
one of Wt1 and Wt2 corresponds to the Nyquist frequency, the value of p is set so as not to lie near nl2 or 
37c/2, thus preventing loss of the frequency component. 
20 The periodic components are added on the position where both of Wt1 and Wt2 correspond to the range 
close to the Nyquist frequency and the degradation tends to occur, as shown in FIG. 13. 

The process of extracting specified information is the same as that explained in the sixth embodiment 

As described above, according to the seventh embodiment, when an amount of specified information is 
relatively small, it can be easily treated. Further, superposition between the periodic components tends to occur 
25 and periodic components of low frequencies which are eyesores tend to occur. In order to prevent this, a phase 
difference in the range of 0 to 2k is given to each periodic component to suppress occurrence of superposition. 
As a result degradation in the image can be prevented. 

Next the eighth embodiment is explained. 

FIG. 14 is a block diagram showing an embedding processing sectton in an image processing apparatus 

30 according to the eighth embodiment of this invention. 

As shown in FIG. 14, an input system 1401 is provided in the embedding processing section i.e. the color 
printer. Graphic data or text data as first color signals Y, M. C Is supplied to bit map developing section 1402. 
The bit map developing section 1402 develops bitmap in accordance with the first color signals Y, M, C supplied 
from the input system 1401 , so as to supply to an adder 1407. 

35 Further, a code generator 1 403 is provided in the embedding processing section. The code generator 1 403 
holds specified holds specified informatk)n to be embedded in the graphic data or the like, generates the spe- 
cified information in a coded form, and supplies the same to information processing section 1404. The infor- 
mation processing section 1404 effects processing for the code supplied from the code generator 1403 for 
encipherment or compression and supplies the result of processing to a pattern generating circuit 1406. 

40 Further, a mode selector 1405 is provided in the embedding processing section. A signal indicating any 
one of the mode is supplied from the mode selector 1406 to the pattern generating circuit 1406. The pattern 
generating circuit 806 generates a pattern signal based on the code supplied from the code generator 805 
and supplies the same to the adder 1407. 

The adder 1407 adds (or subtracts) the pattern signal from the pattern generating circuit 1406 to (or from) 

45 the first color signals Y, M, C from the bit map developing section 1402. The second color signals Y', M', C to 
which the pattern signal is added are supplied to an error diffusion processing circuit 1408. The output from 
the error diffusion processing circuit 1408 is supplied to an output system 1409. The output system 1409 prints 
out a graphic or a text in accordance with the second color signals Y*, M', C. 
Next the operation of the eighth embodiment is explained. 

50 In this embodiment when data is obtained by developing graphic data or text data Into bit map or the like, 
a pattern having frequency components is superposed on the above data. The embedding pattern is based 
on the code data representing contents of e.g. a secret document The pattern is generated by using a Fourier- 
transform plane explained in the fornier embodiments. 

When data into which the pattern will be embedded is binary data such as a character, a binary graphic, 

55 or the like, unprinted portton of the original sheet to be printed may become entire white and printed portion 
may become solid setting. In this case, even if pattern adding on either the unprinted portion or the printed 
potion are performed, an amplitude are reduced into its half, and thus, it becomes difficult to extract pattern 
embedded. In order to soh^e the problem, the pattern is so embedded that a small amount of ink will be given 
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to the field (i.e., unprinted portion of the original sheet). That is, at the time of embedding the pattern, color 
signals YO, MO, CO representing ink amount are given. In this case, the value of color signal (an amount of ink) 
Is preferably approx. 1/6 of amplitude Wl of the frequency component in the range of the Nyquist frequency 
explained In the sixth embodiment. It Is also possible to further reduce to its half for the value of color signal 
5 (an amount of ink) except YO. In this case, it is probable that the field will become yellowly. When color balance 
is more important than luminance balance, color signals are set YO=MO=C0. The conversion of the color signals 
is expressed by the following equations. 

Y' = YO + (Z5;p)2/3 (55) 
M* = MO - (Zip)/3 (56) 
10 C = CO - (2Zp)/3 (57) 

In the case where a representabte gradatton number of the used printer is small, an error diffusion proc- 
essing is effected by the error diffusion processing circuit 1408 for the data into which a pattern has been enrv 
bedded. 

Further, in this embodiment, the mode selector 1405 for selecting one of high-precision mode and normal 
IS mode is provided on a control panel (not shown). It is possible to set so that the pattern generating/embedding 
process will be effected only when high-precision mode is selected. 

Specifically, in case of embedding a pattern to a graphic image, many lines appear. In this case. If the 
band elimination process is effected at the inputting time, the degradation of the information occurs. 

Therefore, on the Fourier transform plane, as shown in FIG. 15, the frequency components causing to gen- 
20 erate a line image (frequent components on the main scanning direction axes or the sub-scanning direction 
axes) are not arranged. 

The process of extracting specified information is the same as that explained in the sixth embodiment. 
As described above, according to the eighth embodiment, in case of treat binary data such as a character, 
a binary graphic, or the like, the specified information is easily embedded/extracted. 

25 Next, a ninth embodiment is explained. 

FIG. 16 is a block diagram showing an embedding processing section in an image processing apparatus 
according to the ninth embodiment of this invention. 

As shown in FIG. 16, the embedding processing section is constructed by two color facsimile i.e. trans- 
mitting unit 161 and receiving unit 162. An input system 1601 is provkJed In the embedding processing section. 

30 Data as first color signals Y, M, C is supplied from the input system 1 601 to a compression/coding section 1602. 
The compression/coding section 1602 effects compression or coding operation based on the data so as to 
supply to an adder 1605. Further, a code generator 1603 holds specified Information A, generates the specified 
information A in a code form, and supplies the same to an information processing section 1604. The information 
processing section 1 604 processes the code supplied from the code generator 1603 for encipherment or com- 

35 pression and supplies the result of processing to the adder 1 605. The adder 1605 adds (or subtracts) the code 
(specified Information A) from the informatton processing sectk>n 1604 to (or from) the data from the conrv 
pression/coding section 1602. The data to which the code (specified information A) is added is transferred to 
a information separating sectton 1606 in the receiving unit 162. The Information separating section 1606 sep- 
arates the specified information Afrom the transferred data, supplies main data to a expanding section 1607 

40 and supplies the specified informatbn A to information synthetic section 1610. The expanding section 1607 
expands the main data to supply to an adder 1612. On the other hand, a code generator 1608 generates a 
code representing unit number of the receiving unit 162 or a code (specified information B) representing work- 
ing section and supplies the same to a information processing section 1609. The information processing sec- 
tion 1609 processes the code (specified information B) supplied from the code generator 1608 for encipher- 

45 ment or compression and supplies the result of processing to the information synthetic section 1610. The in- 
formation synthetic section 1610 synthesizes the specified information Afrom the information separating sec- 
tion 1606 and the specified information B from the information processing section 1606 to supply the synthe- 
sized result to a pattern generating circuit 1611 . The pattern generating circuit 1611 generates a pattern based 
on the synthesized code and supplies the same to the adder 1612. The adder 1612 adds the pattern from the 

so pattern generating circuit 1611 to the data from the expanding section 1607 and supplies the addition result 
to an error diffusion processing circuit 1613. The error diffusion processing circuit 1613 supplies the data from 
the adder 1612 to an output system 1614. The output system 1614 outputs the above data. 
Next, the operation of the ninth embodiments explained. 

When data transfer between e.g. two facsimiles is executed, it is considered both of the case that the spe- 
55 cif led information Is required to be embedded on the transmitting side and the case that the same Is required 
to be embedded on the receiving side. First, it is considered, as a simple means, that after embedding a pattern 
into data, the embedded data is transferred from the transmitting side, and the embedded data is received in 
the receiving skJe. However, it is conskJered that, since the color Information data Itself is so targe, the data is 
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transferred after compressing process is effected. Further, the data is transferred after coding process is ef- 
fected. FIG. 16 shows a sample configuration in relation to the above description. 

The data is processed of compression or coding by the compression/coding section 1602. Next, the coded 
specified information is combined with the main data which is to be transferred as a header or a trailer, as 
shown in FIGS. 17A and 17B. In this case, a starting bit or an end bit as a mark is provided on the boundary. 

The specified information is considered as a unit number indicating the transmitting unit, a data attribute 
(e.g.. classification of the secret matter), or a coded number indicating the transmitting section. On the other 
hand, in the receiving unit 162. the data including the received specified Information Is once separated the 
specified information from the main data. In this case, if necessary, the specified Information (code) which 
representing the unit number or the section number is synthesized with the specified information (code) trans- 
ferred from the transmitting unit 161. The synthesized specified information is generated as a pattern from 
the pattern generating circuit 1611. The pattern Is embedded into the data which has been executed a process 
such as the bit map developing explained in the sixth embodiment. Thereafter, the data Is output through the 
process such as error diffusion process. In the above procedure, it is possible to embedding specified Infor- 
mation only in the transmitting unit 161 but in the receiving unit 162. 

The process of extracting specified information is the same as that explained in the sixth embodiment. 

As described above, according to the ninth embodiment. It is possible to embedding both of the specified 
Information in the transmitting side and In the receiving side, between color facsimiles. Further, it is also pos- 
sible to embedding only the specified information in the transmitting side into the transferring data. 

Next, a tenth embodiment Is explained. 

In the eighth embodiment, the case of application to a color printer is explained, whereas in the tenth env 
bodlrnent, the case of application to monochromatic printer Is explained. In this embodiment, FIG. 14 which is 
used In the eighth embodiment is also used for reference. 

FIG. 14 Is a block diagram showing an embedding processing section in an image processing apparatus 
according to the tenth embodiment of this invention. 

The fourth embodiment is the same as the eighth embodiment except for color primaries of color signals. 
That is, in FIG. 14, first color signals K (not Y. M, C) Is supplied from the input unit 1401 to the bit map memory 
1402, and second color signals IC (not Y', M\ C) are supplied from the adder 1407 to the error diffusion proc- 
essing circuit 1408. 

Next, the operation of the tenth embodiment Is explained. 

It is difficult to vary in color difference direction or chroma direction. However, the monochromatic printer 
has the capability of representing higher resolution e.g. 600 dpi than that of the color printer. When a pattern 
is generated by the pattern generating circuit 1406. a Fourier transform plane is used. Since visual sensitivity 
is high for variation In the luminance direction in the Fourier transform plane, the frequency in limit of eyesight 
is relatively high as shown in FIG. 1 8. That is, higher frequency components than the frequency In limit of eye- 
sight, i.e., 8 [cycle/mm] should be added. Therefore, the range in which frequency components can be arranged 
is limited, as shown in FIG. 18. Like the case of the color printer, the pattern embedding Into data Is executed 
after bit map developing process. 

In case that It is not preferable that original background portton becomes grayish, an embedding technique 
such as varying row pitch or character string pitch in a very small quantity is used. If a high-resolution printer 
is used, a gap of approx. 1 dot does not identified as far as characters does not slide to longitudinal or lateral 
direction. By use of the above characteristic, the row pitch or the character string pitch Is varied for each line 
orcharacter to embed the specified Infonnation. For example, as shown In FIG. 19, row pitch LO, LI or character 
string pitch mO, ml are varied. Further, in case of regular A4 sized document, 40 x 36 characters in size of 
approx. 10 points are arranged on all area of the document. In this case, If using all row pitches and character 
string pitohes, 39+35=74 bits data can be embedded. Further, large amount of specified information can be 
embedded as the resolution of the printer becomes higher. 

The technique for embedding specified information by varying row pitch or character string pitch for each 
line or character Is applicable to a printer wherein text data is not developed to bit map (i.e. a thermal printer). 
That is. even if varying feed pitch of the head (character string pitch) or feed pitch of the recording paper (row 
pitch), the same effect is obtained. 

As described above, this invention has the following effects throughout the first to tenth embodiments. 

By use of this Invention, specified information can be recorded without giving unnatural sense of vision 
when a normal printer is used to output. The recorded pattern can be sufficiently read even if a scanner used 
at the reading time does not have a high resolution exceeding the limit of visual sense. For example, a scanner 
having the same resolution as that used in a hornial copying machine can be used. 

Further, since the color difference and chroma are not substantially present In the frequency band exceed- 
ing the limit of eyesight in general image Informatron, it becomes possible to separate and extract the recorded 
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specified information witli extremely high precision by converting the image information into a color difference 
signal and chroma signal and subjecting the same to the band elimination process. As a result, the image in- 
formation can be prevented from being erroneously read as specified information at the reading time. 

Further, according to this invention, a bar code which cannot be identified by the human eyes can be re- 
5 corded. Therefore, a bar code can be attached to an article to which a bar code cannot be normally attached 
since it is an extremely small article, for example, or which looks bad in design when a bar code is attached 
thereto. 

Further, according to this invention, specified information can be recorded on color image information with- 
out causing a degradation in the image quality of a color image and the specified information recorded on the 

10 color Image information can be separated and read with high precision. 

Further, according to this invention, specified information can be easily embedded even either on an orig- 
inal sheet for color characters or on a graphic image. Further, even if an original sheet for monochromatic image 
or monochromatic characters is used, it is possible to embed Into the specified Information without being vis- 
ually identified. Therefore, the present invention is applicable to not only a color printer but also a color facsimile 

15 or a monochromatic printer. 

For example, the band elimination circuit for eliminating an old infomnation of image when specified infor- 
mation is superposed on the image is provided in the sixth embodiment. However, the band elimination circuit 
is commonly applicable to another embodiments (e.g., the first to three embodiments). Although the specified 
Information is explained with reference to a sample of the detailed output system, the above embodiments 

20 shows It as only one sample and therefore any kind of information can be embedded. In additk>n, not only two- 
dimensional Fourier transform plane but also one-dlmensbnai Fourier transfbnm plane can be applicable to 
the sixth to tenth embodiments wherein Fourier transfonn planes are used for embedding multiplexed frequen- 
cy information. 

25 

Claims 

1 . An apparatus for processing a color image, characterized by comprising: 

means (1 03; 2202) for generating a data signal representing another information which differs from 
30 the color image; and 

image processing means (104, 105; 2203, 2204, 2205) for embedding the another information into 
the color image by varying one of a color difference and a chroma of the color image in accordance with 
the data signal. 

35 2. An apparatus for processing a color image, characterized by comprising: 

means (103; 2202) for generating a data signal representing another information which differs from 
the color image; and 

image processing means (104, 105; 2203. 2204. 2205) for embedding the another infonnation into 
the color image by varying one of a color difference and a chroma of the color image In accordance with 
40 the data signal while keeping a sum of three color component signals of the color image constant 

3. The apparatus according to claim 2, characterized in that said three color component signals are primaries 
of substructive mixture. 

^ 4. The apparatus according to claim 2, characterized in that said three color component signals are primaries 
of additive mbcture. 

5. The apparatus according to claim 1, characterized in that said image processing means includes: 

means (1 02) for converting three color component signals into a luminance signal, a first and sec- 
ond color difference signals, and 

means (105) for embedding the another informatton into the second color difference signal. 

6. The apparatus according to daim 5, characterized in that said first color difference signal is a red-green 
color difference signal and said second color difference signal is a yellow-blue color difference signal. 

55 7. The apparatus according to daim 1, characterized in that said image processing means indudes: 

means (602) for converting tree color component signals into a luminance signal, a first and second 
color difference signals, and 

means (603, 604) for embedding the another information into the first and second color difference 
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8. The apparatus according to claim 7, characterized in that said first color difference signal is a red-green 
color difference signal and said second color difference signal is a yellow-biue color difference signal. 

9. The apparatus according to claim 1, characterized in that said image processing means includes: 
means (2203, 2204, 2205) for embedding the another Information into the color image by varying 

three color component signals of the color Image. 

10. The apparatus according to claim 1, characterized in that said image processing means includes: 
means (2203, 2204) for converting the data signal into a variation of one of the color difference 

and the chroma of the color image; and 

means (2205) for giving the variation to the color Image. 

11. The apparatus according to claim 1 , characterized by further comprising: 
means (108; 2206) for recording the color image into which the another Information is repeatedly 

embedded by said image processing means, on a recording medium, said another information being re- 
peatedly recorded on each area of the recording medium. 

12. The apparatus according to claim 11, characterized by further comprising: 

20 means for extracting the another information from the color image which is recorded on the record- 

ing medium by said recording means. 

13. The apparatus according to claim 12, characterized in that said extracting means includes: 

means for detecting the color Image in which the another information is repeatedly recorded on 
25 the recording medium, and 

means for averaging the color Image which is detected by said detecting means. 

14. The apparatus according to claim 1. characterized by further comprising: 

means (108; 2206) for recording the color image into which the another information is embedded 
30 by said image processing means, on a recording medium. 

15. The apparatus according to claim 14, characterized by further comprising: 

means for extracting the another information from the color image which is recorded on the record- 
ing medium by said recording means. 
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16. The apparatus according to claim 5, characterized by further comprising: 

means (1 06) for converting the color image into which the another information is embedded by said 
image processing means, into three color component signals; 

means (1 08) for recording the color image on a recording medium in accordance with the three color 
component signals; 

means for reading out the color Image which is recorded on the recording medium by said recording 

means; 

means for converting the color image which Is read out by said recording means into the luminance 
signal, the first and second color difference signals; and 

means for extracting the another information from the first color difference signal which Is obtained 
by said converting means. 

17. The apparatus according to claim 7, characterized by further comprising: 

means (607) for converting the color image into which the another information is embedded by said 
image processing means, into three color component signals; 

means (609) for recording the color image on a recording medium in accordance with the three color 
component signals; 

means for reading out the color image which is recorded on the recording medium by said recording 
means; 

means for converting the color image which Is read out by said recording means Into the luminance 
signal, the first and second color difference signals; and 

means for extracting the another information from the first and second color difference signals 
which are obtained by said converting means. 



22 



EP 0 642 060 A2 



18. The apparatus according to claim 15, characterized in that said extracting means includes: 

means for executing band pass processing of predetermined frequency band for the color image 
which Is recorded on the recording medium. 

19. The apparatus according to claim 1« characterized in that said processing means includes: 

means (807) for delecting higher level components of luminance of the color image, and 
means (803, 804, 808a, 808b) for varying an amount of another information to be embedded in 
accordance with the detected higher level components. 

20. An apparatus for processing a color image, characterized by comprising: 

means (904, 905; 2303) for generating a data signal representing another information differs from 
the color image; and 

image processing means (906, 907; 2304, 2305. 2306) for embedding the another information into 
the color image by superposing a moire pattern on the color image while keeping a sum of three color 
component signals of the color image constant, the moire pattern including a plurality of frequency com- 
ponents In accordance with the data signal generated by said generating means. 

21. An apparatus for processing a color image, characterized by comprising: 

means {904, 905; 2303) for generating a data signal representing another information differs from 
the color image; and 

image processing means (906. 907; 2304, 2305, 2306) for embedding the another information into 
the color image by superposing a moire pattern on the color image, the moire pattern including a plurality 
of frequency components in accordance with the data signal generated by said generating means. 

22. The apparatus according to claim 21, characterized in that said image processing means includes: 

means for setting the plurality of frequency components on a plane, and 
means for superposing the moire pattern on the color image, in accordance with an arrangement 
of the plurality of frequency components. 

23. The apparatus according to daim 22, characterized in that said setting means includes: 

means for increasing a frequency of part of the plurality of frequency components as a set point 
of thereof on the plane becomes far from a predetermined point. 

24. The apparatus according to claim 23, characterized in that said setting means Includes: 

means for providing a plurality of dummy frequency components to be set v^th the plurality of fre- 
quency components on the plane. 

25. The apparatus according to claim 22, characterized in that said setting means includes: 

means for arranging part of the plurality of frequency components so that the arrangement will draw 
a circle or an ellipse on the plane. 

26. The apparatus according to claim 22, characterized in that said setting means includes: 

means for anranglng part of the plurality of frequency components so that the arrangement will draw 
a lattice on the plane. 

27. The apparatus according to daim 26, characterized in that said setting means indudes: 

means for shifting phase with regard to the part of the plurality of frequency components to be set 
on the plane. 

28. The apparatus according to daim 22. characterized in that said setting means indudes: 

means for setting a starting bit indicating a starting point of the plurality of frequency components 
on the plane, and 

means for irregularly setting part of the plurality of frequency components. 

29. The apparatus according to daim 22, characterized by further comprising: 

band elimination filter (903; 2302) for eliminating a frequency band, which corresponding to the 
plurality of frequency components, so as to obtain a color image onto the moire pattern is not superposed. 

30. The apparatus according to daim 22, characterized in that said setting means indudes: 

means for increasing an amplitude of part of the plurality of frequency components as a frequency 
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thereof becomes higher. 

31. The apparatus according to claim 22, characterized by further comprising: 

means (909; 2307) for recording the color image which is processed by said image processing 
means and into which the another inforn^tion is embedded, on a recording medium. 

32. The apparatus according to daim 31 , characterized by further comprising: 

means for extracting the another information from the color image which is recorded on the record- 
ing medium by said recording means. 

33. The apparatus according to claim 32, characterized in that said extracting means includes: 

means for executing Fourier transfonm with regard to the color image. 

34. The apparatus according to claim 22. characterized in that said image processing means includes: 

means (902) for converting three color component signals into a luminance signal, a first and sec- 
ond color difference signals, and 

means (907) for embedding the another information into the first color difference signal. 

35. The apparatus according to claim 22, characterized in that said image processing means includes: 

means (902) for converting three color component signals into a luminance signal, a first and sec- 
ond color difference signals, and 

means (907) for embedding the another infonmation into the first and second color difference sig- 
nals. 

36. The apparatus according to claim 34, characterized by further comprising: 

means (908) for converting the color image into which the another information is embedded by said 
image processing means, into three color component signals; v 

means (909) for recording the color image on a recording medium in accordance with the three color 
component signals; 

means for reading out the color image which is recorded on the recording medium by said recording 
means; 

means for converting the color image which is read out by said reading means into the luminance 
signal, the first and color difference signal; and 

means for extracting the another information from the first color difference signal which is obtained 
by said converting means. 

37. The apparatus according to claim 35, characterized by further comprising: 

means (908) for converting the color image Into which the another information is embedded by said 
image processing means, into three color component signals; 

means (909) for recording the color Image on a recording medium in accordance with the three color 
component signals; 

means for reading out the color image which is recorded on the recording medium by said recording 
means; 

means for converting the color image which is read out by said reading means into the luminance 
signal, the first and second color difference signals; and 

means for extracting the another information from the first and second color difference signals 
which is obtained by said converting means. 

38. The apparatus according to claim 36, characterized by further comprising: 

means for executing Fourier transform with regard to the color image. 

39. The apparatus according to claim 37, characterized by further comprising: 

means for executing Fourier transform with regard to the color image. 

40. The apparatus according to claim 36, characterized by further comprising: 

means for detecting predetermined frequency band from the color image. 

41. The apparatus according to claim 37, characterized by further comprising: 

means for detecting predetermined frequency band from the color image. 
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42. An apparatus for processing a monochronriatlc iniage, characterized by comprising: 

means (1403. 1404) for generating a data signal representing another infonmation which differs 
from the monochromatic Image; and 

image processing means (1406, 1407) for embedding the another information Into the monochro- 
matic image by varying luminance of the monochromatic image in accordance with the data signal. 

43. An apparatus for processing character information, characterized by comprising: 

means (1403, 1404) for generating a data signal representing another information which differs 
from the character information; and 

information processing means (1406, 1407) for embedding the another information into the char- 
acter information by varying pitches of arrangement of the character information in accordance with the 
data signal. 

44. An apparatus characterized by comprising: 

means for inputting a second color image formed of a first color image into which another infor- 
mation differing from the first color image has been embedded by varying one of a color difference and 
a chroma of the first color image; and 

means for extracting the another information from the second color image input by said inputting 
means. 

45. An apparatus characterized by comprising: 

means for inputting a second color image formed of a first color image, which includes a luminance 
signal and a first and second color difference signals, and into which another information differing from 
the first color image has been embedded by adding a data signal representing the another information 
to the first color difference signal so as to vary a color difference of the first color image; 

means for reading the second color image input by said inputting means; 

means for converting the second color image read by said reading means Into the luminance signal 
and the first color signal to which the data signal has been added and the second color difference signal; 
and 

means for taking out the data signal from the first color difference signal which is obtained by said 
converting means, so as to obtain the another information. 

46. An apparatus characterized by comprising: 

means for inputting a second color image formed of a first color image, which includes a luminance 
signal and a first and second color difference signals, and into which another infonrnation differing from 
the first color image has been embedded by adding a data signal representing the another information 
to the first and second color difference signals so as to vary a chroma of the first color image; 

means for reading the second color image input by said inputting means; 

means for converting the second color image read by said reading means into the luminance signal 
and the first and second color signals to which the data signal has been added; and 

means for taking out the data signal from the first and second color difference signals whk:h are 
obtained by said converting means, so as to obtain the another information. 

47. An apparatus characterized by comprising: 

means for inputting a second color image formed of a first color image Into which another infor- 
mation differing from the first color image has been embedded by varying one of a color difference and 
a chroma of the first color image, the another information having been repeatedly embedded into each 
area of the first color image; 

means for detecting the each area from the second color image input by said inputting means; 

means for extracting the repeatedly embedded another information from the each area detected 
by said detecting means; and 

means for averaging the repeatedly embedded another information extracted by said extracting 
means. 

48. The apparatus according to claim 44, characterized in that said extracting means includes: 

means for executing band pass processing of predetemnined frequency band for the second color 

innage. 
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